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Introduction,  At  White  Sands  Missile  Range  we  are  interested  in  detecting 
manmade  objects  (targets)  usually  against  a  natural  background  such  as  the 
sky  or  a  mountain.  A  widely  used  method  of  detecting  a  target  is  to  find 
the  edges  in  a  picture  using  some  operator  whose  value  is  high  when  there 
are  many  changes  in  gray  levels.  An  object  which  contrasts  with  the  back¬ 
ground  because  of  step  and  ramp  edges  gives  rise  to  high  values  of  the 
edge  detector.  After  the  detection  of  the  step  and  ramp  edge  points  in  a 
scene,  the  problem  of  detecting  a  target  is  reduced  to  that  of  determining 
which  of  the  points  classified  as  edges  belong  to  the  target.  If  the 
target  is  the  object  of  greatest  contrast  then  its  location  can  be  found 
by  simply  thresholding  for  the  highest  value  of  the  edge  detector. 
However,  if  the  target  is  not  the  object  of  highest  contrast  other  methods 
must  be  used  to  detect  a  target  in  a  scene.  Thus,  we  must  use  properties 
of  the  target  that  are  not  shared  by  other  edge  points  in  a  scene.  The 
targets  that  we  track,  planes  and  rockets,  have  as  one  of  their  main 
geometric  features  several  points  of  very  high  curvature.  Thus  *  to  detect 
edges  which  belong  to  a  target  a  reasonable  procedure  would  be  to  look  for 
edge  points  which  come  from  objects  which  have  high  curvature.  Another 
property  which  makes  manmade  objects  different  from  natural  objects  is  the 
strong  Interior  edges  (extremal  edges)  which  are  present.  This  suggests 
that  another  procedure  for  detecting  objects  such  as  planes  and  rockets  is 
to  measure  In  some  way  the  extremal  edges  present  in  a  scene  and  to  look 
for  the  target  amongst  those  points  of  higher  values.  It  may  be  possible 
that  the  information  present  in  the  gray  level  picture  does  not  have  any 
significant  difference  in  gray  level  between  the  target  and  the  background 
but  the  target  ,  and  the  background  may  be  of  different  colors.  In  this 
case,  we  must  look  a  the  color  information  and  extract  the  edges  from  the 
color  data  before  we  begin  to  look  for  a  target.  M"he  problems  of  finding 
extremal  edges,  finding  curvatures  along  the  boundary  of  objects,  and 
detecting  color  edges,  at  first  sight  appear  unrelated.  The  formulation 
of  these  problems  in  the  framework  of  vector  fields  and  the  application  of 
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this  theoretical  model  to  data  both  from  the  range  and  from  the  laboratory 
are  the  subjects  of  this  paper. 

‘-the  paper  Is  divided  Into  three  parts.  In  the  first  section  we 
discuss  extremal  edges  and  their  detection,  section  2  discusses  curvature 
and  its  measure  and  section  3  formulates  the  detection  of  color  edges  In 
vector  field  language  and  uses  the  theoretical  results  of  sections  1  and 
2  to  detect  color  edges.  Each  section  follows  the  same  paradigm,  namely:^ 

1.  c  The  problems  is  formulated  as  a  problem  In  the  theory  of 
vector  fields^ 

2. ^The  detection  of  a  particular  property  Is  formulated  as  the 
computation  of  an  integral  over  a  vector  field, 

3.  /The  theoretical  results  are  applied  to  data  obtained  from  the 
field  or  In  the  lab^ 

^  An  outline  of  the  mathematical  methods  are  mostly  contained  les¬ 
see  tioe  1  and  are  based'  on  classical  vector  analysis.  Details  of  the 
mathematics  used  appear  In  -  E8-]  and  fH&y.  for  supporting  material  on 
differential  geometry-  see  for  example  Cl]  or  [2].  What  we  call  the 
rotation  degree  of  a  \fector  field  is  also  called  the  topological  degree  of 
the  corresponding  mapping  from  the  unit  circle  to  Itself.  Two  books 
treating  topological  degree  theory  are  [3]  and  [4]. 

Section  I.\  VECTOR  FIELDS  AND  EXTREMAL  EDGES 


The  two  planes  of  figure  1  are  typical  of  the  tracking  situations  that 
occur  at  WSMR.  To  set  these  we  started  with  the  original  video  frames  and 
digitized  the  analog  signal  at  the  rate  of  512  points  per  line.  The  value 
assigned  to  each  point  is  between  0  and  255  and  Is  proportional  to  the 
strength  to  the  analog  signal.  In  these  two  pictures,  that  are  of  very 
low  contrast,  we  have  been  able  to  segment  the  target  by  finding  the 
extremal  edges  arising  from  the  shape  of  the  fuselage  and  wings.  In  terms 
of  a  function  of  two  variables  an  extremal  edge  Is  a  connected  set  of 

extrema  very  similar  to  the  top  points  of  a  roof.  The  classical  develop-  - 

ment  of  extrema  via  partial  derivatives  does  not  give  a  method  for  finding  S 
these  extrema.  The  standard  treatment  of  critical  points  looks  at  the  |f 
auadratic  form  fnf22“f122  ant*  at  ^  using  the  Hessian 
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Figure  1.  (a)  (c)  Two  planes  as  seen  through  a  telescope,  (b)  (d) 

extremal  edges  of  (a)  and  (c)  segment  the  planes  from  the 
background. 


MACHUCA 


the  conditions  for  an  extrema  are: 

max:  determinant  (Hf)  >0  and  fn<0 
min:  determinant  (Hf)  >0  and  fu>0 
non-extrema:  determinant  (Hf)  <0 
cannot  say:  determinant  (Hf)  =  0 

An  example  of  a  function  about  which  nothing  can  be  said  from  this 
test  Is  Z  *  X4  +  Y4.  It  has  a  Hessian  which  vanishes  at  0  and  thus  from 
this  test  no  conclusion  can  be  made  about  the  type  of  critical  point  at 
(0,  0)  even  though  It  Is  obviously  a  minimum.  The  gradient  field  shows 
that  the  function  Is  Increasing  at  every  direction  away  from  (0,  0)  and  so 
the  Information  as  to  the  nature  of  the  extrema  Is  In  the  gradient  field. 

We  can  extract  this  Information  from  the  vector  field  by  calculating 
the  Integral  for  z*x4  +  Y4 


where 


(a)  K(x) 


Hf(x,7  f(x) ) 

|f(x)|Z 


(b)  Hf(x,v  «*))  - 


Dnf 

0,, 


fc)  v  fix)  »  ( — Djjf •  Djf) 


and  do  Is  the  de  of  (figure  2). 


Figure  2.  A  portion  of  a  vector  field. 
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The  fact  that  Z  Is  an  extrema  at  (0,0)  Is  reflected  by  Its  nonzero  value 
of  n.  But  we  are  mainly  Interested  In  detecting  extrema  which  are  not 
Isolated  as  In  the  case  f=X2.  This  function  has  the  line  x*0  as  the  set 
of  Its  extrema.  If  we  look  at  the  Hessian  It  gives  no  Information  which 
can  be  used  to  detect  the  extremal  set:  As  before  we  must  look  at  the 
gradient  field  to  find  the  extrema.  The  gradient  field  of  the  function  as 
before  reveals  the  behavior  of  the  function  at  x=0,  namely  It  Is  Increas¬ 
ing  as  we  move  away  fram  x*0,  thus  there  Is  an  extremal  edge  along  the 


Figure  3.  A  small  neighborhood  of  the  gradient  field  for  the 
function  z»x2. 

Because  of  the  ambiguous  de  at  Bl  and  B2  (figure  3)  the  analytical 
detector  of  extrema  edge  points  becomes  somewhat  complicated.  The  analogy 
of  Isolated  extrema  Is  followed  and  we  define  the  detector  as  an  Integral 
along  the  places  where  It  can  be  defined  and  where  there  Is  an  ambiguity 
we  take  de=>*.  Using  the  quantities  defined  at  (a)  and  (b)  the  analytical 
detector  Is 

n=  f  Kdr  +  f  Kdr  +  Si  +  B2 

Jy  1  J  Y2 

This  gives  a  function  which  Is  equal  to  zero  at  nonextremal  edges  and  1  at 
extremal  edges. 

Once  we  have  Identified  the  extermal  edges  we  want  to  distinguish 
between  weak  and  strong  extremal  edges.  In  the  one  dimensional  case 
(figure  4)  the  quantity  M( e)  =  I  f' (a)  |  +  I  f*  (b) |  will  distinguish  between 
sharply  sloped  roofs  and  weakly  sloped  roofs.  The  two  dimensional 
analogue  of  this  quantity  Is  fy  |  f7|. 


Figure  4.  Weak  and  strong  extremal  edges. 
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figure  5.  (a)  Computer  generated  example,  (b)  edge  points  detected, 

and  (c)  partial  gradient  field  of  (a)  rotated  90  degrees 
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The  computer  application  of  these  methods  Is  done  by  first 
approximating  the  parti als  In  a  3x3  neighborhood  of  a  point  and  from  this 
computing  the  quantities  dQ  and  vf.  A  new  file  is  created  which 
contains  /y|  vf }  when  n=l  and  0  when  n  s  0. 

In  figure  5  we  have  several  extremal  edges  of  the  type  z=x2  and 
z=-x2.  The  darkest  parts  are  like  the  extreme  points  z»*x*  while  the 
brightest  points  are  like  the  extrema  z=-x2.  The  edge  points  exhibited  in 
figure  5  have  been  found  using  the  procedure  described  above.  Figure  1 
contains  pictures  of  a  plane  taken  through  long  distance  optics.  There  Is 
very  little  contrast  In  both  pictures  between  the  plane  and  the  back¬ 
ground.  However,  the  extremal  edges  which  result  from  the  wings  and  the 
fuselage  are  very  easily  detected  by  the  methods  described  above. 

Section  II.  CURVATURE 

This  concept  of  studying  the  gradient  field  to  find  properties  of  a 
scene  can  be.  used  to  find  other  features  of  a  target.  For  example  in 
figure  6,  the  points  of  the  original  in  which  the  contour  has  high 
curvature  have  been  found  by  looking  at  the  gradient  vector  field. 

The  analytical  tools  used  to  detect  curvature  are  the  same  as  those 
used  in  detecting  extremal  edges.  With  the  definitions  the  same  as  (a), 
(b),  and  (c)  above,  the  pointwise  curvature  can  be  computed  from  the 
Hessian  and  the  gradient  and  is  given  by  the  formula 

W(x)  *  -  <  Hf(x,vf(x),  Vf(x))> 
jvfj1 

Because  of  the  amount  of  noise  present  in  these  scenes  a  better  quantity 
to  compute  is  the  average  curvature: 


A*  (K  ,B)=  I  /  3  W  dr 

To  see  that  the  quantity  is  a  measure  of  curvature  we  look  at  the  function 
f(x,y)=  x2  +  y2  and  compute  A*  for  this  function.  If  A*  is  computed  over 
a  small  circle  centered  at  n  as  in  figure  7, 


Ficjure  7.  Contour  lines  and  test  circle. 
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then  if  A*  is  a  good  measure  of  curvature  it  should  be  small  when  n  is 
large  and  large  when  n  is  small.  Using  polar  coordinates  the  polntwise 
curvature  Is  1/r  and  with  the  circles  parametrized  by  (n,0)  +  e  ,  A* 
becomes  the  integral 

dt 

n  ( nz  +  l  +  ?n  cost)  1/2 


/. 


and  this  integral  is  a  maximum  for  n=l  and  decreases  as  n  Increases, 
exactly  what  a  good  measure  of  curvature  should  do.  Figure  8  contains  two 
scenes  obtained  from  range  missions.  Figure  8  (a)  is  a  rocket  at 
takeoff.  The  nose  of  the  rocket  has  been  identified  as  one  of  the  points 
of  high  curvature  and  Is  the  brightest  point  of  (b)  closest  to  the  top. 
The  points  of  high  curvature  generated  by  the  plume  are  also  indicated. 
In  figure  8  (c)  there  is  a  plane  flying  by  a  mountain.  The  points  of  high 
curvature  at  the  nose,  wing,  and  tall  have  been  detected.  There  are  also 
some  others  from  tee  mountain  edge.  Thus,  the  gradient  field  reflects 
many  properties  of  the  original  scene.  We  can  also  look  at  other  vector 
fields  generated  by  scenes  and  find  other  properties  such  as  color  edges. 


Section  III.  COLOR  EDGES 


We  are  mainly  Interested  in  the  analysis  of  color  data  in  the  case 
where  there  Is  no  gray  level  difference  between  the  target  and  the 
background,  i.e.,  in  the  cases  where  the  above  methods  fall.  That  Is  we 
are  looking  for  a  method  for  finding  edges  in  the  case  where  the  target 
cannot  be  separated  from  the  background  by  looking  at  the  luminance 
component  of  a  scene  but  can  be  detected  by  using  the  chrominance 
information.  A  widely  used  color  representation  that  breaks  up  a  color 
into  luminance  and  chrominance  information  is  the  (Y,I,Q)  color 
representation  of  standard  video.  In  this  representation  Y  is  the 
luminance  component,  whfch  we  Ignore  since  our  principal  assumption  is 
that  the  target  and  background  are  similar  in  luminance.  Thus  we  must 
look  at  the  I  and  0  components  to  detect  the  target  from  the  background, 
and  in  particular  we  are  interested  in  edges  caused  by  differences  in  hue 
between  target  and  background. 

For  any  color (Y, I, Q)  the  vector  v  =  (I,Q)  has  the  property  that  the 
angle  it  makes  with  the  I  -  axis,  )(v),  specifies  its  hue  (see  figure  9) 
while  its  absolute  value  gives  the  saturation. 


Figure  9. 
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The  I,  0  Coordinate  System 
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:inure  10.  The  (1,0)  vector  fieM  in  the  neighborhood  of  a  leaf. 
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«  assume  that  the  saturation  is  the  same  for  every  color  of  an  image 
s  is  the  case  for  the  scenes  we  study)  then  the  color  information 
lable  to  detect  the  target  is  all  contained  in  e(v).  In  order  to 
ct  the  edges  from  this  component,  it  is  useful  to  consider  the  vector 
d  T  =  v/lvl  and  use  the  vector  field  formulation  of  section  I  to 
ct  edges  due  to  hue. 

An  example  of  a  vector  field  T  so  generated  appears  in  figure  10.  A 
ion  of  the  vector  field  on  a  test  circle,  selected  from  near  the 
er  of  figure  10  is  shown  in  figure  11. 


Figure  11.  A  portion  of  a  color  edge. 

Figure  11,  we  detect  an  edge  between  the  two  colors,  Mblue)  and 
ellow),  simply  because  the  vectors  point  in  opposite  directions.  Note 
T  rotates  counterclockwise  from  1  to  2  to  3,  clockwise  from  3  to  4  to 
There  are  convexity  changes  at  approximately  "1"  and  "3".  If  the 

le  y  is  parametrized  on  [0,1]  by  y(t)  -  e27r1t,  then  the  argument 

tion  9(t)  is  simply  0  =  Arg(v)  at  the  point  e1  1,1  on  the  circle: 

T  (t)  =  (cos( 9 { t ) ) ,  si n( 0 ( t) ) . 


early,  because  if  we  use  the  integral  as  the  color  edge  detector, 


(ii) 


(t)  idt  = 


I  dal 


ignore  the  change  in  convexity  and  measure  net  rotation, 
re  11  it  is  clear  that 


K-32l 
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(C)  (d) 

Figure  12.  The  R,  G,  8  components  of  "girl  picture"  (a),  (b)  (c) 
and  t.h?  hue  edqeoolnts  (d). 
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The  Integral  J  de  In  (11)  can  be  Interpreted  as  the  average  curvature 
of  the  vector1  field  T;  e.g.,  as  In  (Hi)  for  the  curve  y.  Hence, 
measuring  net  rotation  corresponds  to  measuring  the  average  curvature  of  T 
on  y.  We  have  found  L  de  to  be  a  good  color  edge  detector.  In  fact 
the  vector  field  shownJin  figure  10  Is  generated  by  the  leaf  in  the  R,G,B 
components  showryln  figure  12  a-b-c.  The  result  of  the  average  curvature 
method  -  L  de  -  is  shown  In  figure  12. 

An  alternate  approach  to  detecting  color  edges  would  be  to  follow  the 
classical  development  for  gray  level  edges.  That  Is  compute  abs(grad(R)) , 
abs(grad(G)),  and  abs(grad(B))  and  combine  these  In  some  way  to  find  the 
color  edges.  This  process  requires  that  two  convolutions  take  place  for 
each  of  the  gradients  (one  for  each  partial  derivative),  and  after  the 
gradients  are  computed  there  remains  the  problem  of  how  to  combine  them 
Into  one  output. 

The  edge  detection  method  described  in  this  section  is  particularly 
provocative  because  of  Its  implications  with  regard  to  hardware 
implementations  of  color  edge  detectors.  The  phase  of  the  (I,Q)  vector  is 
easily  available  from  analog  hardware  and  so  the  data  input  to  this 
algorithm  is  available  In  real  time.  The  integration  that  takes  place  for 
the  edge  detection  is  a  type  of  "convolution"  easily  performed  by  state- 
of-the-art  real  time  hardware.  Thus,  with  this  method  an  implementation 
can  be  constructed  with  components  that  are  practically  available  off  the 
shelf,  and  such  a  machine  is  being  built  at  White  Sands  Missile  Range. 

Conclusion.  We  have  shown  that  a  variety  of  image  processing  problems  can 
be  stated  in  terms  of  vector  field  problems  and  that  quantities  easily 
calculated  In  real  time  over  the  associated  vector  fields  can  be  used  to 
detect  image  features.  Extremal  edges  can  be  found  by  computing  the 
rotation  number  of  a  curve  a  via  a  simple  process.  Points  of  high  average 
curvature  are  found  directly  from  the  vector  field,  without  approximate 
surfaces  or  statistics.  It  was  shown  that  the  detection  of  hue  edges 
could  be  done  by  computing  the  rotation  associated  with  the  vector  field 
(1,0),  a  number  that  can  easily  be  computed  in  real  time  by  existing 
hardware  components. 
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